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ABSTRACT 

In an effort to determine if achievement gains of 
low-achieving Chapter l students could be bettered, the Austin 
Independent School District implemented C^.apter l Schoolwide Projects 
(SWP) in two schools to reduce class size to 15 pupils per teacher, 
SWP teachers functioned as regular classroom teachers with students 
of mixed achievement. Chapter 1 students received supplementary 
reading instruction from Chapter 1 teachers. Because 90-95% percent 
of SWP students were Hispanic, analyses were restricted to include 
Hispanic students only. Analyses used were a regression approach to 
analysis of covariance, with the pretest score as covariate. A series 
of regression models was constructed with the posttest as the 
dependent variable, A systematic series of model comparisons resulted 
in discovery of the model which combined the best prediction of 
posttest scores with the fewest predictor vectors. The same 
comparisons have been made since 1980-81, the first year of the 
implementation of SWP in the district. Findings revealed few 
differences between SWP and ..egular Chapter 1, indicating that SWPs 
may be producing some reading achievement gains, bat generally not 
significantly more than the less expensive Chapter 1 Program, *<esults 
are discussed in terms of achievement results, costs, findin^^s from 
the literature, and political considerations. (RH) 
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Schoolwide Projects: 
The Almost Revolution (?) Six Years Later 



Objective 

This paper focuses on our District's experience with reducing class size 
in two elementary schools and its effect on low-u.^^^eving students' 
achievement. The discussion will try to tie together achievement 
results, costs, the literature, and policies. 



Iiitroduction 

When a school has 75% or more low-income students residing in its 
attendance area, it can be eligible to be a Chapter 1 Schoolwide Project 
(SWP). In a SWP Chapter 1 contributes its usual amount based on the 
number of low-achievers, while the District provides additional funds to 
reduce the overall pupil teacher-ratio within the school to 15 to 1, SWP 
teachers paid from Chapter 1 funds function as regular classroom teachers 
with students of mixed achievement levels and a lower pupil teacher 
ratio. All st'jdents ai 3 considered served by Chapter 1 in SWPs, 

Our District funded the only two schools-Allison (grades K-3) and Becker 
(grades K-6) eligible under tnese criteria beginning in 1980-81 and has 
continued funding both through 1986-87. One school has not been eligible 
under Chapter 1 criteria since 1984-85, The District has continued this 
SWP, paying the whole cost. Since the achievement results were less than 
glowing, especially at the upper grade levels, one campus was nade an SWP 
at grades K-3 only and gi\"n supplemental Chapter 1 teachers at the upper 
grade level^ in 1984-85, Due to community pressure in 1985-86 the whole 
school (grades K-6) was funded again as a SWP, 



Methods 

The reason that our District opted to implement SWPs was to see if 
could produce better achievement gains for low-achieving students in SWPs 
than in our regular Chapter 1 program (where fcudents receive 
supplementary reading instruction from Chapter 1 teachers). Therefore 
the gains of low-achieving (pretest score at or below the 30th%ile on the 
Iowa Tests of Basic Skills (ITBS) Reaiing Total) SWP students were 
compared with the gains of simiUr students served in the regular Chapter 
1 program. Because our District was under massive court-ordered 
crosstown bussing for desegregation at all the traditional Chapter 
1/Title I schools, but not at the SWPs, only students who resided in a 
traditional Title I attendance area were included. Finally since between 
90* and 95% of the SWP students were Hispanic, the students in the 
analyses were restricted to Hispan'cs, 
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In all the gains analyses, students who were missing either a pretest or 
a posttest score were omitted. In addition, students with special 
circumstances marked on either their pre- or posttest were omitted. 
Limited English Proficient and Special Education students with valid (not 
^or experience only) pre- and posttest scores were included. The 
dependent variable is the Reading Total grade equivalent (GE) for each 
student (except at kindergarten, when the Language Total GE was used). 
The student's pretest score was used as the covariate. Separate analyses 
were done by grade. 

The analyses used were a regression approach to analysis of covariance, 
with the pretest score as covariate. A series of regression models was 
constructed with the posttv-:t as the dependent variable. See Attachment 
1. The residual sum of squares associated with each model was obtained 
using the GLM (General Linear Models) procedure via SAS (Statistical 
Analysis System) on the District's IBM mainframe system. A systematic 
series of model comparisons was done, until the model was found which 
combined the best prediction of posttest scores (i.e., the lowest 
residual sum of squares) with the fewest predict vectors. All model 
comparisons were evaluated by an F-test. See Attachment i, page 2 for 
the F formual and a flowchart of model comparisons. 

Thef.e same comparisons have been made since 1S80-81— the first year of 
the implementation of SWP in our District. 



Results 

In looking at the 1985 to 7.986 results, there were few differences 
between SWP and regular Chapter 1. See Figure 1. At grades K-3 and 6, 
there were no statistically significant differences. At grade 4, SWP 
students had higher gains. At grade 5, the SWP students at the lowest 
achievement levels gained more, while for the relatively higher scoring 
low-achieving students there were no differences between the groups. 
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Figure 1. KcAN PRE- AND P05TTES7 I7B5 READING TOTAL (LANGUASE TOR K), 
BY GRADE FOR SIMILAR LOW-ACHIEVING STUDENTS AT BECKER AND 
CHAPTER 1 SCHUuLS, 1985-86. 



Figure 2 shows there were no statistically significant differences in the 
gains at grades K-3 between the two SWP schools. 
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Figure z. MEAN PRE- AND POSTTEST GE ITBS READING TOTAL (LANGUAGE: FOR K), 
BY GRADE FOR SIMILAR LOW-ACHIEVING STUDENTS AT ALLISON AND 
BECKER, 1985-86. 



Since Limited English Proficient (LEP) students are an important subgroup 
of these students similar regression analyses were performed o"^ 
low-achieving LEP students. The students selected were not retained and 
resided in a traditional Title I attendance area. Figure 3 below 
presents these results by grade. T!iere were no statistically reliable 
differences in gains. The number of students were small in each group so 
these results should be interpreted cautiously. 
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higure 3. MEAN PRE- AND POSTTEST GE I7BS READING TOTAL (LANGUAGE FOR K), 
BY GRADE FOR SIMILAR LOW-ACHIEVING STUDENTS AT SWP AND 
CHAPTER 1 SCHOOLS, 1985-36. 



Going back to the picture of all low-achiovers, how do the one-year 
achievement gains of SWP students during the lasv, six years compare with 
gains made by Chapter 1 students? As can be seen illustrated in Figure 
4, there were clearly superior achievement gains in the first year for 
SWP low-achievers. However, in years since the results have been mixed 
with only one or two grade levels showing clear gains across achievement 
levels. 
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GRADE 



Year K 1 2 3 4 5 — Z 





Nn 

Scores 
Avail- 
able 




4. 


•I- 4- 4- 4- 


1981-82 


+ 


+ 


• 


• - • • 


1982-83 


• 


★ 


+ 




1983-84 


+ 


* 




• • t • 


1984-85 


• 




+ 


• (there were no grades 
4, 5, 6 SWP students) 


1985-86 


• 


3 


• 


0 + g 



Legend: 

+ = Schoolwide Project (SWP) students did better 
- = Chapter 1 Regular students did better 

• = No difference between SWP and Chapter 1 Regular students 

* = SWP students who had higher pretesc scores did better; no 

difference otherwise 

** = SWP students who had higher pretest scores did better; 
Chapter 1 Regular students with iower pretest scores did 
better 

*** = SWP students with lower pretest scores did better; no 
difference otherwise 

Figure 4. SuMMAkY OF LOW-AChlEVINS SWP STUDEiTS' ACHIEVEMENT GAINS VS. 

CHAPTER 1 STUDENTS' ACHIEVEMENT GAINS FOR 1980-81 THROUGH 
1985-86. 



More details of these analyses car, be found in Doss, Washington, Moede, 
and Mulkey, 1981; Carorud, Burleson, and Washington, 1982; Carsrud, 
Sailor, and Washington, 1983; Jordan-Davis, Sailor, and Rodgers, 1984, 
Jordan-Davis, Sailor, and Rodgers, 1985; and Christner, Rodgers, Leben, 
and Prevost, 1985. 
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Discussion 

After the first year's glowing achievement results described in two AERA 
papers (Doss and Holley, 1982 and Carsrud and Doss, 1983) where is the 
"almost revolution" (as Carsrud and Doss labeled SWPs) now? Over the 
long term the achievement results for low-achievers produced look less 
than revolutionary. 

At the end of the 1985-86 school year, the District had invested over 
$1.6 million dollars in teacher salaries and benefits over and above the 
regular school contribution to lower the pupil teacher ratio to 15 to 1. 
Chapter 1 had invested 1.2 million dollars— the amount it would have 
invested with or without Schoolwide Projects in these two schools. Was 
the extra 1.6 million dollars worth it? This really depends on which 
variable you look at and how you look at it. 

Achievement is the variable we have focused on since SWPs were created to 
be a better achievement boost to low-achieving students than was the 
regular Title I/Chapter I Program. The data in Figure 4 represent our 
best comparison of Chapter 1 and SWP low-achieving students. 

One of the problems we have with interpreting these data is the variation 
in the results each year. The first year all grades showed out^^tanding 
gains. The next year it was grades K, 1; the next it was part of grade 1 
and grade 2 and parts of grades 3, 5, and 6, etc. Ther,e result's are 
difficult to explain because there is no truly consistent pattern. 

Why did our students start off with such a bang and continue less than 
glowingly? We have some hypotheses, but not absolute answers. 

During the years our District has had SWPs, two other things have 
happened to make il: harder for SWP to produce higher gains than Chapter 1 
students and higher gains than other schools in the District as a whole. 
One of the primary 3chool Board priorities over the last several years 
has been to increase minority student achievement. Due to the 
districtwide efforts occurring as a result of this emphasis the 
achievement scores of minority students over all have slowly, but surely 
been increasing— this is especially true of Hispanics. The second thing 
that has occured is a strengthening of the regular Chapter 1 Program. 
Over the same time period that SWPs have been in existence the Department 
of Elementary Education and the compensatory coordinators have really 
focused on improving the Chapter 1 Program— especially the coordination 
with the regular education program. This has paid off in a stronger 
program that has been producing better gains. SWPs therefore has harder 
competition than it might have otherwise. 

Proponents of SWPs in our District have pointed to the decreased number 
of Chapter 1 eligible students at SWP campuses as one sign of their 
success. This has indeed been the case. The percent of Chapter 1 
eligible students has gone from 66% in 1980-81 to 40% in 1986-87. 
However, although this certainly is a positive sign, there has been a 
decrease districtwide in the number of Chapter 1-eligible students. 
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Therefore one cannot (with certainty) attribute the decrease in eligible 
students solely to SUPs. 

What about longer term achievement gains? In 1983-84 a followup was done 
of achievement levels of students who had been in SWPs for four years and 
students in regular Title I/Chapter 1 schools. All compared students 
were low-achievers initially. Fonner SWP kindergarteners had a two-nonth 
achievement advantage over similar Chapter 1 students. Fonner grades 1 
and 2 students show no differences in gains. While higher-scoring SW^* 
low-achievers at grade 3 had a three-month advantage, lower-scoring SWP 
low-achievers at grade 3 (in 1980-81) had the same gains as their Chapter 
1 counterparts. 

Does the school community like SWPs? You bet! When SWP was reduced to 
grades K-3 at Becker in 1984-85, the Becker parents and local community 
raised a fuss. So much so that it was community pressu**e that got SWPs 
reinstated across all grade levels in 1985-86. Ironically the Chapter 
1-served, non-SWP students at Becker in 1984-85 made as good gains as 
their SWP counterparts. 

Do principals and teachers like SWPs? Yes! The principals have remained 
staunch supporters of the SWP program over its years of implementation. 
In 1980-81 interviews with teachers indicated they loved SWPs. No 
teacher interviews have been done since and many of the teachers 
initially in the schools are no longer at the schools. 

What does all this mean? It means that SWPs as they are currently 
operating may be producing some reading achievement gains and 
improvement, but generally not significantly more than the less expensiva 
Chapter 1 Program. The community likes the program and does not want 
SWPs "taken away" from them. In interviewing Chapter 1 principols this 
year (Christner, Rodgers, Fairchild, and Gutierrez, 1987), the large 
rrajority felt lowering the pupil teacher ratio was the single best way to 
improve the achievement of low-achievers. 

Glass, Cohen, Smith, and Filby (1982) are strong proponents of lowering 
the pupil-teacher ratio to get achievement gains. Robinson and Wittebols 
(1986) offer a more cautious summary of class size and achievement 
gains. With our District's experience with SWPs, we must take the 
cautious roaJ as well. Lowering the pupil teacher ratio does not 
guarantee achievement gains. Robinson and Wittebols (1986) ^^eport that 
lowering the class size will probably not benefit students a whole lot if 
teachers use the same instructione 1 methods, etc. that they use in larger 
classes. This is one factor I feel may well explain why our SWPs have 
not produced consistently large achievement gains. There has been no 
continuing staff development for SWP teachers (many of whom are new to 
SWPs) on how to take advantage of smaller class size and teach 
differently than would be don^ with a larger class. 

Ironically this AERA paper almost never got written. Our School Board is 
strongly considering going back to neighborhood schools at grades K-5. 
Currently many elementary schools are paired and there is massive 
crosstown bussing. My staff and I have been involved in doing analyses 



ERIC 



9 



86.38 



of how proposed changes in the boundaries affect the school populations. 
Also various literature reviews have been conducted on how best to 
improve minority and disadvantaged student achievement. This has been a 
very hectic process to get information the Board and the Administration 
could use to plan, etc, in a timely manner. The ironic part is what is 
being planned for the 16 schools which would have a high minority 
enrollment if the plan is passed. You probably guessed it— Schoolwide 
Projects! 
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Variables 



Attachment 1 
(Page 1 of 2) 



U 
1 
2 
3 
A 
5 
6 
7 
8 
9 

10 
11 
12 



utilt vector 

posttest 

pretest 

pretest If group 1; 0, otherwise 

pretest If group 2; Oi otherwise 

pretest if group 3; 0> otherwise 

pretest squared (variable 2 squared) 

variable 3 squared 

variable 4 squared 

variable 5 squared 

1 of group 1; 0, otherwise 

1 if group 2; 0, otherwise 

1 if group 3; 0, otherwise 



Models 



Model 1 
Model 2 



Model S 

nodctl 6 
Model 7 



1-U+3+A + 5 + 7 + 8+ 9+10 
+11+12 

1-U+3+A+5 + 6 + 10 
+ 11 + 12 



Model 3 J « U + 2 + 6 + 10 + 11 + 12 



Model A l-U+2+6 



1-U+3+A + 5 + 10 
+11+12 



1 - U + 2 + 10 + 11 + 12 



I - U + 2 



Cornments 

Allows independent curvilinear 
regression lines • 

Requires quadratic component 
of lines tc be equ^.l for each 
group. Intercepts may differ. 

Requires parallel curvilinear 
regression lines. Intercepts 
may differ. 

Requires parallel curvilinear 
regression lines with common 
intercept. 

Allows independent (different) 
linear (straight line) regression 
lines. 

Requires common linear slopes; 
and intercepts may differ. 

Requires common linear slopes 
and common intercepts. 
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Calculation of F for Model Comparisons 



F - (ESSj - ESSf)/dfi 



ESSf/df. 



Where 



ESSf » residual sum of squares for the model with fewer 
predictors (restricted model). 

ESC^ « residual s*im of squares for the model with more 
predictors (full model). 

df 2 ■ the number oi Independent predictor vectors In the full 
model minus the number In the restricted models 

df2 * the number of cases minus the nu&ber of Independent 
predictors In the full model. 
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